Problem Note 49866: Performance degradation might occur in SASĀ® Merchandise Data Integration during downloads when running dimension load
When running the SAS Merchandise Data Integration mdi_loaddm_merch_cmast and mdi_loaddm_merch_hierarchy jobs, the program performs both of these tasks:
- downloads db_dictitionary for all table objects
- creates run-time SAS code for each table object that handles default and null values
Performing both tasks impacts the overall performance of the jobs.
In addition, the post-hierarchy load process executes reclass-related steps each time the load runs. The steps should run only during the reclass process (when UPDATE_HIERARCHY=Y). Running the additional steps impacts the overall performance of the hierarchy load.
To improve the performance issue, create run-time SAS code only for hierarchy-related table objects that handle default and null values. To address the post hierarchy load issue, add a validation to run the reclass-related steps only when UPDATE_HIERARCHY=Y. Contact SAS Technical Support to get replacement mdi_loaddm_merch_hierarchy.sas and mdi_loaddm_merch_cmast.sas files that address each issue.
To implement this solution, follow these steps.
Make a backup copy of the following files:
$MDI_ROOT/code/sascode/mdi_loaddm_merch_hierarchy.sas
$MDI_ROOT/code/sascode/mdi_loaddm_merch_cmast.sas
- Save the replacement mdi_loaddm_merch_hierarchy.sas and
mdi_loaddm_merch_cmast.sas files in
$MDI_ROOT/code/sascode.
A fix for this issue is planned for a future software release.
Operating System and Release Information
SAS System | SAS Merchandise Data Integration | 64-bit Enabled Solaris | 6.1.3 M6 | 6.4 | 9.1 TS1M3 SP4 | 9.4 TS1M0 |
64-bit Enabled AIX | 6.1.3 M6 | 6.4 | 9.1 TS1M3 SP4 | 9.4 TS1M0 |
Microsoft Windows Server 2003 Standard Edition | 6.1.3 M6 | | 9.1 TS1M3 SP4 | |
*
For software releases that are not yet generally available, the Fixed
Release is the software release in which the problem is planned to be
fixed.
SAS Merchandise Data Integration dimension load performance: db_dictionary and post product load processing
Type: | Problem Note |
Priority: | high |
Date Modified: | 2013-05-28 16:25:03 |
Date Created: | 2013-05-03 16:22:15 |